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Image Pickup Apparatus 

BACKGROUND OF THE INVENTION 
Field of the Invention 
5 The present invention relates to an image pickup 

apparatus for generating a color image signal from 
light incident from a color filter array, to an image 
signal read method of reading an image signal from the 
image pickup apparatus; to a computer process method of 

10 generating an image signal, to a computer readable 
storage medium storing programs, to a processing 
apparatus for obtaining an image signal; and to an 
image pickup system including the image pickup 
apparatus and the processing apparatus. 

15 Related Background Art 

In order to obtain a color image signal in an 
image pickup apparatus, light is incident upon image 
pickup elements via a color filter. The color filter 
includes a primary color filter and a complementary 

20 color filter. The primary color filter has three 

colors, red, green, and blue, whereas the complementary 
color filter has four colors, cyan, yellow, magenta, 
and green. A cyan color filter intercepts only red 
color in the visible light range, an yellow color 

25 filter intercepts only blue color in the visible light 
range, a magenta color filter intercepts only green 
color in the visible light range, and a green color 
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filter -transmits only green light. 

In the case of complementary color filters , a 
luminance signal Y is given by: 

Y = Ye + G + Cy + Mg . . . ( 1 ) , 

5 a blue color difference signal is given by: 

CB = ( G + Ye ) - ( Mg + Cy ) . . . ( 2 ) , 

and a red color difference signal is given by: 

CR = (Cy + G) - (Ye + Mg) ... (3) 

wherein Cy is a signal picked up by image pickup 
10 elements via cyan color filters. Ye is a signal picked 
up by image pickup elements via the yellow color 
filters, Mg is a signal picked up by image pickup 
elements via magenta color filters, and G is a signal 
picked up by image pickup elements via green color 
15 filters. 

Fig. 1 shows a pattern of color filters according 
to a first conventional example. This pattern has a 
periodicity of two pixels in the horizontal direction 
and four pixels in the vertical direction. With this 
20 color filter pattern, the luminance signal Y can be 

obtained through the equation (1) by using Cy, Ye, Mg, 
and G in a block of 2 x 2 pixels, two pixels in the 
horizontal direction and two pixels in the vertical 
direction. Similarly the blue and red color difference 
25 signals CB and CR can be obtained through the equations 
(2) and (3) by using Cy, Ye, Mg, and G in the block of 
2x2 pixels. 



Fig- 2 shows a pattern of color filters according 
to a second conventional example. This pattern has a 
periodicity of two pixels in the horizontal direction 
and four pixels in the vertical direction. With this 
5 color filter pattern, the luminance signal Y can be 

obtained through the equation (1) by using Cy, Ye, Mg, 
and G in a block of 2 x 2 pixels, two pixels in the 
horizontal direction and two pixels in the vertical 
direction. Similarly the blue and red color difference 

10 signals CB and CR can be obtained through the equations 
(2) and (3) by using Cy, Ye, Mg, and G in the block of 
2x2 pixels. 

A digital still camera with an image pickup 
apparatus reads an image at high speed with a sacrifice 

15 of resolution before an image is photographed. In 

accordance with the image signal read at high speed, an 
image is displayed in a finer such as a liquid crystal 
finder, an iris is adjusted, a white balance is 
adjusted, or other preliminary operations are 

20 performed. However, with a combination of the color 

filter layout shown in Fig. 1 and a conventional image 
pickup apparatus CCD, even if the pixel signal is read 
at high speed with a sacrifice of resolution by 
thinning every second pixel in the vertical direction, 

25 for example, only cyan and yellow signals are obtained 
so that the while balance cannot be adjusted in 
accordance with outputs of the image pickup elements. 
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Also with the combination of the color filter 
layout shown in Fig. 1 and a conventional image pickup 
apparatus CCD, data of two adjacent pixels in the 
vertical direction is added and thereafter transferred 
5 in the image pickup apparatus and output therefrom. 

Therefore, paired image data is output from the image 
pickup apparatus. More specifically, referring to Fig. 
1, a pair of data of pixels (CI, Rl ) and (CI, R2 ) is 
output, then a pair of data of pixels (C2, Rl) and (C2, 

10 R2) is output, then pairs of data of column pixels in 
the rows Rl and R2 are sequentially output. Next, a 
pair of data of pixels (CI, R3 ) and (CI, R4) is output, 
then a pair of data of pixels (C2, R3 ) and (C2, R4 ) is 
output, then pairs of data of column pixels in the rows 

15 R3 and R3 are sequentially output. Since these outputs 
are used, the calculation of the equation (2) can be 
made, for example, for the rows Rl and R2, but it 
cannot be made for the rows R3 and R4. Similarly, the 
calculation of the equation (3) can be made, for 

20 example, for the rows R3 and R4, but it cannot be made 
for the rows Rl and R2 . Therefore, the color 
difference signal for each color can be obtained only 
from one row among the four rows of image pickup 
elements so that the resolution of the color difference 

25 signal lowers in the vertical direction. 

With the combination of the color filter layout 
shown in Fig. 2 and a conventional image pickup 



apparatus CCD, a signal read in a high speed read mode 
can be used for adjusting the white balance. 

With the combination of the color filter layout 
shown in Fig. 2 and a conventional image pickup 
5 apparatus CCD, data of two adjacent pixels in the 

vertical direction is added and thereafter transferred 
in the image pickup apparatus and output therefrom. 
Therefore, paired image data is output from the image 
pickup apparatus. More specifically, referring to Fig. 

10 2, a pair of data of pixels (CI, Rl ) and (CI, R2 ) is 

output, then a pair of data of pixels (C2, Rl ) and (C2, 
R2) is output, then pairs of data of column pixels in 
the rows Rl and R2 are sequentially output. Next, a 
pair of data of pixels (CI, R3 ) and (CI, R4 ) is output, 

15 then a pair of data of pixels (C2, R3 ) and (C2, R4 ) is 
output, then pairs of data of column pixels in the rows 
R3 and R3 are sequentially output. Since these outputs 
are used, the calculation of the equation (2) can be 
made, for example, for the rows Rl, R2, R3, and R4, but 

20 it cannot be made for the rows R5, R6, R7, and R8. 

Similarly, the calculation of the equation (3) can be 
made, for example, for the rows R5, R6, R7, and R8, but 
it cannot be made for the rows Rl, R2, R3, and R4. 
Therefore, the color difference signal for each color 

25 can be obtained only from two rows among the eight rows 
of image pickup elements so that the resolution of the 
color difference signal lowers in the vertical 
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direction. 

SUMMARY OF THE INVENTION 

It is an object of the present invention to obtain 
5 an image signal having a high resolution both in the 
horizontal and vertical directions. 

It is another object of the present invention to 
provide a multi-mode such as a mode of outputting an 
image signal at high speed which signal can be used for 

10 simple color display, autofocus, white balance 

adjustment and a mode of outputting an image signal 
having a high resolution.. 

In order to achieve the above objects, an image 
pickup apparatus according to an embodiment of the 

15 invention comprises: a plurality of pixels; a color 

filter array of four colors disposed on the plurality 
of pixels, wherein said color filter array has a 
periodicity of two rows x two columns, and colors of 
four color filters in a periodical unit of two rows x 

20 two columns are all different from each other. 

An image pickup apparatus according to another 
embodiment of the invention comprises: a plurality of 
pixels; a color filter array of four colors disposed on 
the plurality of pixels; first calculating means for 

25 calculating a difference between an average signal of a 
first row, first column signal and a first row, second 
column signal in an area of two rows x two columns and 



an average signal of a second row, first column signal 
and a second row, second column signal in the area of 
two rows x two columns; and second calculating means 
for calculating a difference between an average signal 
of a first row, first column signal and a second row, 
first column signal in the area of two rows x two 
columns and an average signal of a first row, second 
column signal and a second row, second column signal in 
the area of two rows x two columns. 

An image pickup apparatus according to another 
embodiment comprises; a plurality of pixels; a color 
filter array disposed on the plurality of pixels and 
having a periodicity of two rows x two columns; and 
calculating means for calculating two color difference 
signals from each color filter of two rows x two 
columns in the color filter array having the 
periodicity of two rows x two columns. 

Other objects and features of the present 
invention will become more apparent from the following 
detailed description of embodiments when read in 
conjunction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 shows a pattern of conventional color 
filters. 

Fig. 2 shows another pattern of conventional color 
filters . 
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Fig. 3 shows a pattern of color filters according 
to a first embodiment of the invention. 

Fig. 4 is a diagram illustrating a read method 
according to the first embodiment of the invention. 
5 Fig. 5 is a circuit diagram of an image pickup 

apparatus according to a second embodiment of the 
invention. 

Fig. 6 is a timing chart illustrating the 
operation of the image pickup apparatus shown in Fig. 
10 5. 

Fig. 7 is a circuit diagram of an image pickup 
apparatus according to a third embodiment of the 
invention. 

Fig. 8 is a timing chart illustrating the 
15 operation of the image pickup apparatus shown in Fig. 
6. 

Fig. 9 is a circuit diagram of an image pickup 
apparatus according to a fourth embodiment of the 
invention. 

20 Fig. 10 is a timing chart illustrating the 

operation of the image pickup apparatus shown in Fig. 
9. 

Fig. 11 is a diagram showing an image pickup 
system with an image pickup apparatus, according to a 
25 fifth embodiment of the invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
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Fig. 3 shows a pattern of color filters according 
to the first embodiment of the invention. This pattern 
has a periodicity of two pixels in the horizontal 
direction and two pixels in the vertical direction. In 
5 a pattern of two pixels in the horizontal direction and 
two pixels in the vertical direction, the first row has 
G and Ye color filters disposed in this order from the 
left, and the second row has Cy and Mg color filters 
disposed in this order from the left. The pattern of 
10 color filters may be reversed right and left, or up and 
down. 

The luminance signal Y, blue color difference 
signal CB, and red color difference signal CR can be 
calculated respectively from the equations ( 2 ) and ( 3 ) 

15 by using Cy, Ye, Mg, and G signals in various color 
filter patterns. Fig. 4 shows a pattern of color 
filters constituted of a fundamental pattern of two 
pixels in the horizontal direction and two pixels in 
the vertical direction. With reference to Fig. 4, 

20 particular read methods will be described. 
1st Read Method: 

Color difference signals CB are calculated from 
adjacent pairs of a series of signals output from image 
pickup elements, the series being: 

25 (Gl + Yel), (Cyl + Mgl ) , (G2 + Ye2 ) , (Cy2 + Mg2 ) , 

( G3 + Ye3 ) , ( Cy3 + Mg3 ) , ( G4 + Ye4 ) , ( Cy4 + Mg4 ) , . . . 
and the color difference signals CD being, for example: 
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CB1 = (Gl + Yel) - (Cyl + Mgl ) 
CB2 = (G2 + Ye2) - ( Cy2 + Mg2 ) 
CB3 = (G3 + Ye3) - (Cy3 + Mg3 ) 
CB4 = (G4 + Ye4) - (Cy4 + Mg4 ) . 

Color difference signals CR are calculated from 
adjacent pairs of a series of signals output from image 
pickup elements, the series being: 

(Gl + Cyl), (Yel + Mgl), (G2 + Cy2), (Ye2 + Mg2), 
( G3 + Cy3 ) , ( Ye3 + Mg3 ) , ( G4 + Cy4 ) , ( Ye4 + Mg4 ) , . . . 
and the color difference signals CR being, for example: 
CR1 = (Gl + Cyl) - (Yel + Mgl) 
CR2 = (G2 + Cy2) - (Ye2 + Mg2 ) 
CR3 = (G3 + Cy3) - (Ye3 + Mg3 ) 
CR4 = (G4 + Cy4) - (Ye4 + Mg4 ) . 
With the first read method, the color difference 
signals CB and CR each can be obtained from two pixels 
in the horizontal direction and two pixels in the 
vertical direction, resulting in a high resolution. 
2nd Read Method: 

A luminance signal Y is calculated from a series 
of signals output from image pickup elements, the 
series being: 

(Gl + Cyl + G3 + Cy3), (Yel + Mgl + Ye3 + Mg3 ) , 
( G2 + Cy2 + G4 + Cy4 ) , ( Ye2 + Mg2 + Ye4 + Mg4 ) , . . . 
and the luminance signals Y being, for example: 

Yl = (Gl + Cyl + G3 + Cy3 ) + (Yel + Mgl + Ye3 + Mg3 ) 
Y2 = ( G2 + Cy2 + G4 + Cy4 ) + ( Ye2 + Mg2 + Ye4 + Mg4 ) . 
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With the second read method, one luminance signal Ye is 
obtained for every two pixels in the horizontal 
direction. The level of the luminance signal Y is 
high. The luminance signal Y generated by this method 
5 is suitable for an autofocus detecting signal 

particularly when an object has a high horizontal 
resolution such as a fine vertical stripe pattern and 
has a low luminance. 
3rd Read Method: 
10 A luminance signal Y is calculated from a series 

of signals output from image pickup elements, the 
series being: 

(Gl + Yel + G2 + Ye2), (Cyl + Mgl + Cy2 + Mg2 ) , 
( G3 + Ye3 + G4 + Ye4 ) , ( Cy3 + Mg3 + Cy4 + Mg4 ) , . . . 
15 and the luminance signals Y being, for example: 

Yl = (Gl + Yel + G2 + Ye2 ) + (Cyl + Mgl + Cy2 + Mg2 ) 
Y2 = ( G3 + Ye3 + G4 + Ye4 ) + ( Cy3 + Mg3 + Cy4 + Mg4 ) . 
With the third read method, one luminance signal Ye is 
obtained for every two pixels in the vertical 
20 direction. The level of the luminance signal Y is high 
in the vertical direction. The luminance signal Y 
generated by this method is suitable for an autofocus 
detecting signal particularly when an object has a high 
horizontal resolution such as a fine horizontal stripe 
25 pattern. 

4th Read Method: 

Color difference signals CB are calculated from 



adjacent pairs of a series of signals output from image 
pickup elements, the series being: 

(Gl + Yel), (Cyl + Mgl), ( G2 + Ye2 ) , (Cy2 + Mg2 ) , . . . 
and the color difference signals CB being, for example: 
5 CB1 = (Gl + Yel) - (Cyl + Mgl) 

CB2 = (G2 + Ye2) - (Cy2 + Mg2 ) . 

Color difference signals CR are calculated from 
adjacent pairs of a series of signals output from image 
pickup elements, the series being: 
10 (G3 + Cy3), (Ye3 + Mg3 ) , (G4 + Cy4 ) , (Ye4 + Mg4 ) , . . . 

and the color difference signals CR being, for example: 

CR1 = (G3 + Cy3) - (Ye3 + Mg3 ) 

CR2 = (G4 + Cy4) - (Ye4 + Mg4 ) . 
With the fourth read method, a color difference line 
15 sequential signal can be obtained. The fourth read 

method is suitable for a moving image object, because 
the number of read signals is a half of the first read 
method . 

5th Read Method: 
20 Color difference signals CB are calculated from 

adjacent pairs of a series of signals output from image 
pickup elements, the series being: 

(Gl + Yel), (Cyl + Mgl), (G2 + Ye2), (Cy2 + Mg2 ) , . . . 
and the color difference signals CB being, for example: 
25 CB1 = (Gl + Yel) - (Cyl + Mgl) 

CB2 = (G2 + Ye2) - (Cy2 + Mg2 ) . 

Color difference signals CR are calculated from 
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adjacent pairs of a series of signals output from image 
pickup elements, the series being: 

( G2 + Cy2 ) , ( Ye2 + Mg2 ) , ( G4 + Cy4 ) , ( Ye4 + Mg4 ) , . . . 
and the color difference signals CR being, for example: 
5 CR1 = (G2 + Cy2) - (Ye2 + Mg2 ) 

CR2 = (G4 + Cy4) - (Ye4 + Mg4 ) . 
The fifth read method is suitable for a moving image 
ob j ect . 

An image signal can be read at high speed because 
10 the number of read color difference signals of pixels 
is a half of the first read method. 
6th Read Method: 

Color difference signals CB are calculated by the 
method similar to the fifth read method. 
15 Color difference signals CR are calculated from 

adjacent pairs of a series of signals output from image 
pickup elements, the series being: 

(Gl, Cyl), (Yel, Mgl ) , (G3, Cy3 ) , (Ye3, Mg3 ) , . . . 
and the color difference signals CR being, for example: 
20 CR1 = (Gl + Cyl) - (Yel + Mgl) 

CR2 = (G3 + Cy3) - (Ye3 + Mg3 ) . 
The sixth read method is suitable for a moving image 
ob j ect . 

An image signal can be read at high speed because 
25 the number of read color difference signals of pixels 
is a half of the first read method. 
7th Read Method: 
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Color difference signals CB are calculated by the 
method similar to the fifth read method. 

Color difference signals CR are calculated from 
adjacent pairs of a series of signals output from image 
5 pickup elements, the series being: 

(Gl, Cyl), (Yel, Mgl), (G2, Cy2 ) , (Ye2, Mg2 ) , . . . 
and the color difference signals CR being, for example: 
CR1 = (Gl + Cyl) - (Yel + Mgl) 
CR2 = (G2 + Cy2) - (Ye2 + Mg2 ) . 
10 The sixth read method is suitable for a moving image 
object. 

An image signal can be read at high speed because 
the number of read color difference signals of pixels 
is a half of the first read method. 
15 The color difference signals CB and CR are 

obtained from the same area. 
8th to 11th Read Methods: 

Color difference signals CB are calculated from 
adjacent pairs of a series of signals output from image 
20 pickup elements, the series being: 

( Gl + Yel ) , ( Cyl + Mgl ) , ( G3 + Ye3 ) , ( Cy3 + Mg3 ) , . . . 
and the color difference signals CB being, for example: 
CB1 = (Gl + Yel) - (Cyl + Mgl) 
CB2 = (G3 + Ye3) - (Cy3 + Mg3 ) . 
25 The color difference signals CR are calculated by 

the similar method to the fourth to seventh read 
methods. The eighth to eleventh read methods are 
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suitable for a moving image object. 

An image signal can be read at high speed because 
the number of read color difference signals of pixels 
is a half of the first read method. 
5 12th Read Method: 

Color difference signals CB are calculated from 
adjacent pairs of a series of signals output from image 
pickup elements, the series being: 

(Gl + Yel), (Cyl + Mgl ) , . . . 
10 and the color difference signal CB being, for example: 

CB1 = (Gl + Yel) - (Cyl + Mgl) 

Color difference signals CR are calculated from 
adjacent pairs of a series of signals output from image 
pickup elements, the series being: 
15 (G4, Cy4), (Ey4, Mg4),... 

and the color difference, signal CR being, for example: 

CR1 = (G4 + Cy4) - (Ye4 + Mg4 ) 

The twelfth method is suitable for a moving image 
ob j ect . 

20 An image signal can be read at high speed because 

the number of read color difference signals of pixels 
is a quarter of the first read method. 
13th Read Method: 

Luminance signals Y are calculated from adjacent 
25 pairs of a series of signals output from image pickup 
elements, the series being: 

(Gl + Yel), (Cyl + Mgl), (G2 + Ye2 ) , (Cy2 + Mg2 ) , 



( G3 + Ye3 ) , ( Cy3 + Mg3 ) , ( G4 + Ye4 ) , ( Cy4 + Mg4 ) , . . . 
and the luminance signals Y being, for example: 
Yl = (Gl + Yel) + (Cyl + Mgl ) 
Y2 = (G2 + Ye2) + ( Cy2 + Mg2 ) 
5 Y3 = (G3 + Ye3) + ( Cy3 + Mg3 ) 

Y4 = ( G4 + Ye4 ) + ( Cy4 + Mg4 ) . 
14th Read Method: 

Luminance signals Y are calculated from adjacent 
pairs of a series of signals output from image pickup 
10 elements, the series being: 

(Gl + Cyl), (Yel + Mgl), (G2 + Cy2 ) , (Ye2 + Mg2 ) , 
( G3 + Cy3 ) , ( Ye3 + Mg3 ) , ( G4 + Cy4 ) , ( Ye4 + Mg4 ) , . . . 
and the luminance signals Y being, for example: 
Yl = (Gl + Cyl) + (Yel + Mgl) 
15 Y2 = (G2 + Cy2) + (Ye2 + Mg2) 

Y3 = (G3 + Cy3) + (Ye3 + Mg3 ) 
Y4 = (G4 + Cy4) + (Ye4 + Mg4). 

The above read methods may be used while pixels 
are read by thinning them in the unit of a fundamental 
20 pattern or a plurality of fundamental pattern to 
thereby speed up a read operation. 

Next, a circuit structure realizing the read 
method of the first embodiment using CMOS sensors as an 
example of image pickup elements, according to the 
25 second embodiment of the invention, will be described. 

Fig. 5 is a circuit diagram showing the structure 
of a CMOS sensor of the second embodiment. In this 



embodiment, the CMOS sensor includes: a first output 
series for output ting a difference between an average 
value of detection light amounts of two pixels adjacent 
in the vertical direction in one column and an average 
5 value of detection light amounts of two pixels adjacent 
in the vertical direction in the next column; and a 
second output series for outputting a difference 
between an average value of detection light amounts of 
two pixels adjacent in the horizontal direction in one 

10 row and an average value of detection light amounts of 
two pixels adjacent in the horizontal direction in the 
next row. Therefore, the CMOS sensor of this 
embodiment can use the first read method - 

Referring to Fig. 5, reference numeral 1 

15 represents a vertical scan circuit for generating an 
enable signal which enables a control signal of each 
row, the enable signal sequentially becoming active in 
the vertical direction. Reference numeral 100 
represents a photodiode serving as a photodetector for 

20 converting incidence light into electric charges. 

Reference numeral 101 represents a transfer transistor 
for transferring the electric charges generated by the 
photodiode 100 to a floating diffusion region 101 which 
temporarily stores the transferred electric charges. 

25 Reference numeral 103 respresents a reset transistor for 
discharging electric charges accumulated in the gate of 
an amplifier transistor 104. Reference numeral 121 
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represents a switching transistor. The elements 100 to 
104, and 121 constitute one pixel. Reference numeral 
112 represents a constant current source transistor 
which is activated by a voltage applied to a terminal 
5 7. Reference numeral 105 represents a transistor for 
discharging electric charges in capacitors 109 , 110, 
117, and 118. Reference numeral 106 represents a 
current distribution division transistor for connecting 
the source of the transistor 104 to the capacitor 109. 

10 Reference numeral 107 represents a current distribution 
transistor for connecting the source of the transistor 
104 to the capacitor 110. The capacitors 109 and 110 
function as a line memory which is charged by a voltage 
supplied from the transistor 104. Reference numeral 

15 108 represents an averaging transistor for averaging 
the electric charges in the capacitors 109 and 110. 
Reference numeral 111 represents a switching transistor 
for applying a voltage of the line memory 109 to a 
buffer 123 at the front stage of a differential 

20 amplifier 122 which amplifies a difference between 

voltages across the capacitors 109 and 109 ' . Reference 
numeral 113 represents a switching transistor for 
connecting the source of the transistor 104 to a 
capacitor 117. Reference numeral 114 represents a 

25 switching transistor for connecting the source of the 
transistor 104 to a capacitor 118. The capacitors 117 
and 118 are charged by a current supplied from the 
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source of the transistor 104. Reference numeral 115 
represents a switching transistor for controlling to 
average the electric charges stored in the capacitors 
117 and 117'. Reference numeral 116 represents a 
5 switching transistor for controlling to average the 

electric charges stored in the capacitors 118 and 118'. 
Reference numeral 119 represents a switching transistor 
for supplying a voltage of the line memory 117 to a 
buffer 129 at the front stage of a differential 

10 amplifier 127 which amplifies a difference between 
voltages across the capacitors 117 and 118'. The 
constant current source transistor 112 is activated in 
the unit of a row, and paired with the transistor 104 
to constitute an amplifier. 

15 Fig. 6 is a timing chart illustrating an operation 

of the CMOS sensor shown in Fig. 5. With reference to 
Figs. 5 and 6, the operation of the CMOS sensor shown 
in Fig. 5 will be described. 

At timing T201, a pulse applied to a terminal 11 

20 takes a high state, and pulses applied to M terminals 

30, 31, 50, and 51 take the high state. Therefore, the 
line memories 109, 110, 117, and 118 are reset to 
initial potentials. At the same time, a start pulse 
applied to a terminal 2 of the vertical scan circuit 1 

25 and a scan pulse applied to a terminal 3 take the high 
level, so that the vertical scan circuit 1 starts 
scanning to select the first row. A high level pulse 
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is applied to a terminal 8 to reset the floating 
diffusion regions of the pixel area. At timing T202, a 
reset pulse at the terminal 8 falls so that the 
floating diffusion regions of first row pixels are made 
5 in an electrically floating state. At timing T203, a 
high level pulse is applied to a terminal 9 so that 
electric charges are transferred from photodiodes of 
the first row to the floating diffusion regions. At 
timing T204, a high level pulse is applied to terminals 

10 10, 30, and 50 so that a voltage proportional to light 
amounts detected with the photodetectors of the first 
row is read to the capacitors 109 and 117 via the 
amplifier 104. At timing T205, the vertical scan pulse 
3 falls. At timing T206, the vertical scan pulse 3 

15 again rises to select the second row. At timing T207, 
a reset pulse false so that the floating diffusion 
regions of pixels of the second row are made in an 
electrically floating state. At timing T208, similar 
to timing T203, a high level pulse is applied to the 

20 terminal 9 so that electric charges are transferred 
from photodiodes of the second row to the floating 
diffusion regions. At timing T209, similar to timing 
T204, a high level pulse is applied to terminals 10, 
30, and 51 so that a voltage proportional to light 

25 amounts detected with the photodetectors of the second 
row is read to the capacitors 110 and 118 via the 
amplifier 104 of the second row. At timing T210, a 
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high level pulse is applied to terminals 40, 60, and 61 
to average the electric charges on the line memories. 
At timing T211, a horizontal scan circuit 4 starts 
scanning so that averaged voltages are sequentially 
5 applied in the horizontal direction to the differential 
amplifiers 122 and 127. The differential amplifiers 
122 and 127 outputs a blue color difference signal CB 
and a red color difference signal CR. By connecting 
adders (not shown) made of an operational amplifier or 

10 the like to the terminals 70 and 71 and to the 

terminals 80 and 81, luminance signals can be output. 

If the averaging operation by the averaging 
transistor 108 is not performed and the signals of all 
rows are temporarily stored in the capacitor 109, an 

15 output signal of each pixel in the odd column can be 
obtained from the output terminal 71, and an output 
signal of each pixel in the even column can be obtained 
from the output terminal. 70. 

Fig. 7 is a circuit diagram showing the structure 

20 of a CMOS sensor of the third embodiment. In this 

embodiment, the CMOS sensor includes an output series 
for outputting an average value of detection light 
amounts of two pixels adjacent in the horizontal 
direction or an average of detection light amounts of 

25 four pixels adjacent in the horizontal direction. 

Therefore, the CMOS sensor of this embodiment can use 
the third read method by summing the two outputs of the 
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CMOS sensor. 

In Fig. 7, like elements to those similar to the 
CMOS sensor of the second embodiment are represented by 
using identical reference numerals, and the duplicated 
5 description thereof is omitted. Reference numeral 301 
represents a switching transistor for controlling to 
average electric charges accumulated in capacitors 109 
and 109 ' . Reference numeral 302 represents a switching 
transistor for controlling to average electric charges 

10 accumulated in capacitors 110 and 110'. Reference 
numeral 301 ' represents a switching transistor for 
controlling to average electric charges accumulated in 
capacitors 109" and 109"'. Reference numeral 302' 
represents a switching transistor for controlling to 

15 average electric charges accumulated in capacitors 110" 
and 110"'. Reference numeral 303 represents a 
switching transistor for controlling to average 
electric charges accumulated in the capacitors 109 ' and 
109". Reference numeral 304 represents a switching 

20 transistor for controlling to average electric charges 
accumulated in the capacitors 110' and 110". If the 
switching transistors 301, 301', and 303 are operated 
synchronously, the electric charges stored in the 
capacitors 109, 109', 109", and 109"' are averaged. 

25 For example, if after or when the switching transistors 
301 and 301' are turned on, the switching transistor 
303 is turned on, these transistors average the 



electric charges stored in the capacitors 109, 109 ' , 
109", and 109"'. If the switching transistors 302, 
302', and 304 are operated synchronously, these 
transistors average the electric charges stored in the 
5 capacitors 110, 110', 110", and 110"'. Namely, if 

after or when the switching transistors 302 and 304' 
are turned on, the switching transistor 304 is turned 
on, these transistors average the electric charges 
stored in the capacitors 110, 110' , 110", and 110"'. 

10 Fig. 8 is a timing chart illustrating an operation 

of the CMOS sensor shown in Fig. 7. With reference to 
Figs. 7 and 8, the operation of the CMOS sensor shown 
in Fig. 7 will be described. 

At timing T401, a start pulse applied to a 

15 terminal 2 of the vertical scan circuit 1 and a scan 
pulse applied to a terminal 3 take the high level, so 
that the vertical scan circuit 1 starts scanning to 
select the first row. A high level pulse is applied to 
a terminal 8 to reset the floating diffusion regions of 

20 the pixel area. At timing T402, a reset pulse at the 

terminal 8 falls so that the floating diffusion regions 
of first row pixels are made in an electrically 
floating state. At timing T403, a high level pulse is 
applied to a terminal 9 so that electric charges in the 

25 photodetectors of the first row are transferred to the 
floating diffusion regions. At timing T404, a high 
level pulse is applied to terminals 10 and 50 so that a 
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voltage proportional to light amounts detected with the 
photodetectors of the first row is read to the 
capacitor 109 via the amplifier 104. At timing T405, 
the vertical scan pulse 3 rises. At timing T406, the 
5 vertical scan pulse 3 again falls to select the second 
row. At timing T407, a reset pulse false so that the 
floating diffusion regions of pixels of the second row 
are made in an electrically floating state. At timing 
T408, similar to timing T403, a high level pulse is 

10 applied to the terminal 9 so that electric charges are 
transferred from photodiodes of the second row to the 
floating diffusion regions. At timing T409 , similar to 
timing T404, a high level pulse is applied to terminals 
10, and 51 so that a voltage proportional to light 

15 amounts detected with the photodetectors of the second 
row is read to the capacitor 110 via the amplifier 104 
of the second row. At timing T410, a high level pulse 
is applied to terminals 60, 61, 90, and 91 to average 
the electric charges in the capacitors 109, 109', 109", 

20 and 109" ' on the line memories and to average the 

electric charges in the capacitors 110, 110', 110", and 
110"' on the line memories. At timing T411, a 
horizontal scan circuit 4 starts scanning so that 
averaged voltages are sequentially output in the 

25 horizontal direction. Since a luminance signal is 

output in this embodiment, only one output terminal 16 
is used. If a plurality of output terminals like those 



shown in Fig. 7 are used, color difference signals can 
be obtained. 

Fig. 9 is a circuit diagram showing the structure 
of a CMOS sensor of the fourth embodiment. In this 
5 embodiment, the CMOS sensor includes an output series 
for outputting an average value of detection light 
amounts of two pixels adjacent in the vertical 
direction or an average of detection light amounts of 
four pixels adjacent in the vertical direction. 

10 Therefore, the CMOS sensor of this embodiment can use 
the second read method by summing the two outputs of 
the CMOS sensor. 

In Fig. 9, like elements to those similar to the 
CMOS sensor of the third embodiment are represented by 

15 using identical reference numerals, and the duplicated 
description thereof is omitted. Reference numerals 
501, 502, 503, and 504 represent current distribution 
transistors for distributing current supplied from a 
transistor to capacitors 508, 109, 510, and 511. The 

20 capacitor 508 stores signals from first row 

photodetectors , the capacitor 509 stores signals from 
second row photodetectors, the capacitor 510 stores 
signals from third row photodetectors, and the 
capacitor 511 stores signals from fourth row 

25 photodetectors. Reference numeral 505 represents a 
switching transistor for controlling to average 
electric charges accumulated in the capacitors 508 and 
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509. Reference numeral 506 represents a switching 
transistor for controlling to average electric charges 
accumulated in the capacitors 509 and 510. Reference 
numeral 507 represents a switching transistor for 
5 controlling to average electric charges accumulated in 
the capacitors 510 and 511. If the switching 
transistors 505, 506, and 507 are operated 
synchronously, the electric charges stored in the 
capacitors 508, 509, 510, and 511 are averaged. For 
10 example, if after or when the switching transistors 505 
and 507 are turned on, the switching transistor 506 is 
turned on, these transistors average the electric 
charges stored in the capacitors 508, 509, 610, and 
511. 

15 Fig. 10 is a timing chart illustrating an 

operation of the CMOS sensor shown in Fig. 9. With 
reference to Figs. 9 and 10, the operation of the CMOS 
sensor shown in Fig. 9 will be described. 

At timing T601, a start pulse applied to a 

20 terminal 2 of the vertical scan circuit 1 and a scan 
pulse applied to a terminal 3 take the high level, so 
that the vertical scan circuit 1 starts scanning to 
select the first row. A high level pulse is applied to 
a terminal 8 to reset the floating diffusion regions of 

25 the pixel area. At timing T602, a reset pulse at the 

terminal 8 falls so that the floating diffusion regions 
of first row pixels are made in an electrically 



floating state. At timing T603, a high level pulse is 
applied to a terminal 9 so that electric charges in the 
photodetectors of the first row are transferred to the 
floating diffusion regions. At timing T604, a high 
5 level pulse is applied to terminals 10 and 30 so that a 
voltage proportional to light amounts detected with the 
photodetectors of the first row is read to the 
capacitor 508. At timing T605, the vertical scan pulse 
3 rises. At timing T606, the vertical scan pulse 3 

10 again rises to select the second row. At timing T607, 
a reset pulse falls so that the floating diffusion 
regions of pixels of the second row are made in an 
electrically floating state. At timing T608, similar 
to timing T603, a high level pulse is applied to the 

15 terminal 9 so that electric charges are transferred 
from photodiodes of the second row to the floating 
diffusion regions. At timing T609, similar to timing 
T604, a high level pulse is applied to terminals 10, 
and 31 so that a voltage proportional to light amounts 

20 detected with the photodetectors of the second row is 

read to the capacitor 509. Similarly at timing T610, a 
high level pulse is applied to terminals 10 and 32 so 
that a voltage proportional to light amounts detected 
with the photodetectors of the third row is read to the 

25 capacitor 510. Similarly at timing T611, a high level 
pulse is applied to terminals 10 and 33 so that a 
voltage proportional to light amounts detected with the 
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photodetectors of the fourth row is read to the 
capacitor 511. At timing T612, a high level pulse is 
applied to the terminals 40 and 41 to average the 
electric charges in the capacitors 508, 509, 510, and 
5 511 on the line memories. At timing T613, a horizontal 
scan circuit 4 starts scanning so that averaged 
voltages are sequentially output in the horizontal 
direction. Voltages proportional to average values of 
light amounts detected with the photodetectors of the 

10 first to fourth rows are sequentially output from an 
output terminal 70 . 

If the averaging operation by the switching 
transistor 506 is not performed, an average value of 
the first and second columns may be output from the 

15 output terminal 70 and an average value of the third 
and fourth columns may be output from an output 
terminal 71. A difference between the average value of 
the first and second columns and the average value of 
the third and fourth columns may be output from an 

20 output terminal 72 . 

In the operation described with reference to Figs. 
5 to 10, a reset voltage at the floating diffusion 
regions may be read to another line memory, prior to 
reading image signals of pixels. In this case, by 

25 using a difference between the reset voltage and the 
image signal, a variation of output voltages to be 
caused by a variation of threshold voltages of 



transistors 104 can be eliminated. Therefore, an image 
signal with a high S/N ratio can be obtained which does 
not contain noise components to be generated by a 
variation of image signals caused by a variation of 
5 amounts of light detected with photodetectors . 

Vertical/horizontal scanning may be performed by 
thinning pixels in the unit of one block or a plurality 
of blocks so that more compressed image signals can be 
obtained . 

10 Other photoelectric conversion elements may be 

used to obtain similar advantages of the above 
embodiments . 

In the above embodiments, a CMOS sensor is used as 
an example of image pickup elements. Other image 
15 pickup elements such as CCD and SIT may also be used. 

In the above embodiments, color filters of four 
colors including yellow Ye, magenta Mg, cyan Cy, and 
green G are used. Other color filters may also be used 
if they can obtain a luminance signal and color 
20 difference signals. 

Fig. 11 is a block diagram showing the structure 
of an image pickup system with an image pickup 
apparatus, according to the fifth embodiment of the 
invention . 

25 Referring to Fig. 11, signals from pixels of an 

image pickup apparatus 91 such as a CMOS sensor are 
supplied directly to an A/D converter 92, without 
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processing the signals such as addition calculation to 
obtain color difference signals and a luminance signal. 
After the signals are converted by the A/D converter 92 
into digital signals, they are stored in a memory 93. 
5 A computer 94 performs necessary calculations for 

digital signals stored in the memory 93 to obtain a 
luminance signal and color difference signals. 
Software for running the computer 94 may be stored in a 
storage medium storing programs. The storage medium 
10 storing such programs may be a floppy disk, a hard 

disk, an optical disk, a magneto-optical disk, a CD- 
ROM, a magnetic tape, a semiconductor memory, and a 
like. 

As described so far, according to the embodiments, 
15 a color image signal with color difference signals 
having a high resolution both in the horizontal and 
vertical directions can be obtained, for example by 
using the first read method. 

According to the embodiments, there are various 
20 read modes relative to the same color filer pattern. 

Accordingly, the embodiments can be applied to a multi- 
mode such as a mode of outputting an image signal at 
high speed which signal can be used for simple color 
display, autofocus, white balance adjustment and a mode 
25 of outputting an image signal having a high resolution. 

Many widely different embodiments of the present 
invention may be constructed without departing from the 
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spirit and scope of the present invention. It should 
be understood that the present invention is not limited 
to the specific embodiments described in the 
specification, except as defined in the appended 
claims . 
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WHAT IS CLAIMED IS: 

1. An image pickup apparatus comprising: 
a plurality of pixels; and 

a color filter array of four colors disposed on 
5 said plurality of pixels, 

wherein said color filter array has a periodicity 
of two rows x two columns, and colors of four color 
filters in a periodical unit of two rows x two columns 
are all different from each other. 

10 

2. An image pickup apparatus according to claim 
1, wherein the four color filters include a filter of 
transmitting only green light in a visible light range, 
a filter of intercepting only blue color in the visible 

15 light range, a filter of intercepting only green light 
in the visible light range, and a filter of 
intercepting only red light in the visible light range. 

3 . An image pickup apparatus according to claim 
20 1, further comprising means for performing an operation 

of A + B - C - D, where A, B, C, and D represent 
signals picked up from an area of two rows x two 
columns . 

25 4. An image pickup apparatus according to claim 

3, wherein the signals A and B are disposed on a same 
line or on a same column, and the signals C and D are 



disposed on a same line or on a same column. 



5. An image pickup apparatus according to claim 
3, further comprising means for performing an operation 
5 of A + C - B - D. 



6. An image pickup apparatus according to claim 
5, wherein the signals A and B are disposed on a same 
line or on a same column, and the signals C and D are 
10 disposed on a same line or on a same column. 



7. An image pickup apparatus according to claim 
1, further comprising means for reading a difference 
between an addition signal of a first row, first column 

15 signal and a first row, second column signal and an 
addition signal of a second row, first column signal 
and a second row, second column signal, respectively in 
an area of two rows x two columns column, and means for 
reading a difference between an addition signal of a 

20 first row, first column signal and a second row, first 
column signal and an addition signal of a first row, 
second column signal and a second row, second column 
signal, respectively in the area of two rows x two 
columns column. 



8. An image pickup apparatus according to claim 
7, wherein the areas of two rows x two columns are 
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disposed without any space therebetween. 

9 . An image pickup apparatus according to claim 
1, further comprising means for reading an addition 
signal of all signals in an area of four rows x one 
column. 

10. An image pickup apparatus according to claim 

I, further comprising means for reading an addition 
signal of all signals in an area of one row x four 
columns . 

11. An image pickup apparatus comprising: 
a plurality of pixels; 

a color filter array of four colors disposed on 
said plurality of pixels and having a periodicity of 
two rows x two columns; and 

calculating means for calculating two color 
difference signals from each color filter of two rows x 
two columns in said color filter array having the 
periodicity of two rows x two columns. 

12. An image pickup apparatus according to claim 

II , wherein said calculating means performs an 
operation ofA+B-C-D, where A, B, C, and D 
represent signals picked up from an area of two rows x 
two columns. 
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13. An image pickup apparatus according to claim 
12, wherein the signals A and B are disposed on a same 
line or on a same column and the signals C and D are 
disposed on a same line or on a same column. 

14. An image signal read method of reading an 
image signal from the image pickup apparatus recited in 
claim 1, wherein an image signal is read by performing 
an operation of A + B - C - D, where A, B, C, and D 
represent signals picked up from an area of two rows x 
two columns . 

15. An image signal read method according to 
claim 14, wherein the signals A and B are disposed on a 
same line or on a same column, and the signals C and D 
are disposed on a same line or on a same column. 

16. An image signal read method according to 
claim 14, wherein an image signal is read by performing 
an operation ofA+C-B-D. 

17. An image signal read method according to 
claim 16, wherein the signals A and B are disposed on a 
same line or on a same column, and the signals C and D 
are disposed on a same line or on a same column. 

18. An image signal read method of reading an 
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image signal from the image pickup apparatus recited in 
claim 1, wherein a difference between an addition 
signal of a first row, first column signal and a first 
row, second column signal and an addition signal of a 
5 second row, first column signal and a second row, 

second column signal, respectively in an area of two 
rows x two columns column, is read as a first color 
difference signal, and a difference between an addition 
signal of a first row, first column signal and a second 
10 row, first column signal and an addition signal of a 
first row, second column signal and a second row, 
second column signal, respectively in the area of two 
rows x two columns column, is read as a second color 
difference signal. 

15 

19. An image signal read method according to 
claim 15, wherein the areas of two rows x two columns 
are disposed without any space therebetween. 



20 20. An image signal read method of reading an 

image signal from the image pickup apparatus recited in 
claim 1, wherein an addition signal of all signals in 
an area of four rows x two columns is read as a 
luminance signal . 

25 

21. An image signal read method of reading an 
image signal from the image pickup apparatus recited in 



claim 1, wherein an addition signal of all signals in 
an area of two rows x four columns is read as a 
luminance signal. 



5 22. An image pickup apparatus comprising: 

a plurality of pixels; 

a color filter array of four colors disposed on 
said plurality of pixels; 

first calculating means for calculating a 

10 difference between an average signal of a first row, 
first column signal and a first row, second column 
signal in an area of two rows x two columns and an 
average signal of a second row, first column signal and 
a second row, second column signal in the area of two 

15 rows x two columns; and 

second calculating means for calculating a 
difference between an average signal of a first row, 
first column signal and a second row, first column 
signal in the area of two rows x two columns and an 

20 average signal of a first row, second column signal and 
a second row, second column signal in the area of two 
rows x two columns. 



23. An image pickup apparatus according to claim 
25 22, wherein: 

said first calculating means comprises first 
storing means for storing the first row, first column 
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signal, second storing means for storing the first row, 
second column signal, third storing means for storing 
the second row, first column signal, fourth storing 
means for storing the second row, second column signal, 
5 first averaging means for averaging the signals stored 
in said first and second storage means, second 
averaging means for averaging the signals stored in 
said third and fourth storage means, and first 
difference calculating means for calculating a 

10 difference between an averaged signal of the signals 
stored in said first and second storage means and an 
averaged signal of the signals stored in said third and 
fourth storage means; and 

said second calculating means comprises fifth 

15 storing means for storing the first row, first column 

signal, sixth storing means for storing the second row, 
first column signal, seventh storing means for storing 
the first row, second column signal, eighth storing 
means for storing the second row, second column signal, 

20 third averaging means for averaging the signals stored 
in said third and fourth storage means, fourth 
averaging means for averaging the signals stored in 
said fifth and sixth storage means, and second 
difference calculating means for calculating a 

25 difference between an averaged signal of the signals 
stored in said fifth and sixth storage means and an 
averaged signal of the signals stored in said seventh 
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and eighth storage means. 

24. An image signal processing apparatus for the 
image pickup apparatus recited in claim 1, comprising 

5 means for performing an operation ofA+B-C-D, 

where A, B, C, and D represent signals picked up from 
an area of two rows x two columns. 

25. An image signal processing apparatus 

10 according to claim 24, wherein the signals A and B are 
disposed on a same line or on a same column, and the 
signals C and D are disposed on a same line or on a 
same column. 

15 26. An image signal processing apparatus 

according to claim 24, further comprising means for 
performing an operation ofA+C-B-D. 

27. An image signal processing apparatus 
20 according to claim 26, wherein the signals A and B are 
disposed on a same line or on a same column, and the 
signals C and D are disposed on a same line or on a 
same column. 

25 28. An image signal processing method for the 

image pickup apparatus recited in claim 1, comprising a 
step of performing an operation ofA+B-C-D, where 
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A, B, C, and D represent signals picked up from an area 
of two rows x two columns. 

29 . An image signal processing method according 
5 to claim 28, wherein the signals A and B are disposed 

on a same line or on a same column, and the signals C 
and D are disposed on a same line or on a same column. 

30. An image signal processing method according 
10 to claim 28, comprising a step of performing an 

operation ofA+C-B-D. 

31 . An image signal processing method according 
to claim 30, wherein the signals A and B are disposed 

15 on a same line or on a same column, and the signals C 
and D are disposed on a same line or on a same column. 

32. A computer readable storage medium storing a 
program for the image pickup apparatus recited in claim 

20 1, wherein the program performs an operation of A + B - 
C - D, where A, B, C, and D represent signals picked up 
from an area of two rows x two columns. 

33 . A computer readable storage medium according 
25 to claim 32, wherein the signals A and B are disposed 

on a same line or on a same column, and the signals C 
and D are disposed on a same line or on a same column. 
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34. A computer readable storage medium according 
to claim 32, wherein the program further includes a 
program of performing an operation ofA+C-B-D. 

5 35. A computer readable storage medium according 

to claim 34, wherein the signals A and B are disposed 
on a same line or on a same column, and the signals C 
and D are disposed on a same line or on a same column. 

10 36. An image pickup system comprising the image 

pickup apparatus recited in claim 1 and the image 
signal processing apparatus recited in claim 24. 

37. An image pickup system comprising the image 
15 pickup apparatus recited in claim 1 and the image 
signal processing apparatus recited in claim 26. 
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ABSTRACT OF THE DISCLOSURE 

An image pickup apparatus having a plurality of 
pixels; and a color filter array of four colors 
disposed on the plurality of pixels, wherein the color 
5 filter array has a periodicity of two rows x two 
columns, and colors of four color filters in a 
periodical unit of two rows x two columns are all 
dif ferent. 



10 
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FITZPATRICK, CELLA, HARPER & SCINTO 
Customer Number: 05514 



I hereby declare that all statements made herein of my own knowledge are true and that all statements made on information and 
belief are believed to be true, and further that these statements were made with the knowledge that willful false statements and the like 
so made are punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of the United States Code and that such 
willful false statements may jeopardize the validity of the application or any patent issued thereon 

■ First Inventor I SAMU UENO . — 



Full Name of Sole o 
Inventor's signature 
Date 



Residence 2-5-407, Minamiqaoka 



_ Citizen/Subject of Japan 

3-chome, Hadano-shi , 



Kanagawa-ken, Japan 

Post Office Address 
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Full Name of Second Joint Inventor, if any SHIGETOSHI SUGAWA 

Second Inventor's signature 

Date Citizen/Subject of Japan 



Residence 13-3, Mor inQsat o 3 - chome , Atsuqi-shi, Kanaqawa-ken, Japan 

Post Office Address 



Full Name of Third Joint Inventor, if any KATSUHISA OGAWA 
Third Inventor's signature 



Date Citizen/Subject of Japan 



Residence 5-4-606, Nakamachi 1- chome, Machida-shi , Tokyo, Japan 



Post Office Address _ 



Full Name of Fourth Joint Inventor, if any TORU KOIZUMI 
Fourth Inventor's signature 



Date Citizen/Subject of Japan 

Residence 2 4 - 1 6 - 101, Shirane-cho 3 -cho me, Asahi-ku, Yokohama - shi , 
Kanaqawa-ken, Japan 



Post Office Address _ 



Full Name of Fifth Joint Inventor, if any TETSUNOBU KOCHI 
Fifth Inventor's signature 



Date Citizen/Subject of Japan 



Residence 5567-1-509, Tamura, Hiratsuka-shi , Kanaqawa-ken, Japan 



Post Office Address _ 



Full Name of Sixth Joint Inventor, if any KATSUHITO SAKURAI 
Sixth Inventor's signature 



Citizen/Subject of Japan 



Residence 2405-40, Kanaimachi , Machida-shi, Tokyo, Japan 



Post Office Address _ 



Full Name of Seventh Joint Inventor, if any HIROKI HIYAMA 
Seventh Inventor's signature 



Date Citizen/Subject of Japan 



Residence 10-1, Asahi-cho 2 - chome , Atsuqi-shi, Kanaqawa-ken, Japan 



Post Office Address _ 
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